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Abstract: 

In some classification problems the feature space Is heterogeneousin that the best 
features on which to base the classificationare different in different parts of the 
feature space. In some other problems the classes can be divided into subsetssuch 
that distinguishing one subset of classes from anotherand classifying examples 
within such subsetsrequire very different decision rules, Involving different sets of 
features. In such heterogeneous problems, many modeling techniques(including 
decision trees, rules, and neural networks)evaluate the performance of alternative 
decision rulesby averaging over the entire problem space, and are prone to 
generating amodel that is suboptimal in any of the regions or subproblems.Better 
overall models can be obtained by splitting the problemapprophately and modeling 
each subproblem separately. 

This paper presents a new measure to determine the degree of dissimiiaritybetween 
the decision surfaces of two given problems, and suggests a way tosearch for a 
strategic splitting of the feature space that identifiesregions with different 
characteristics.We illustrate the concept using a multiplexor problem. 
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